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RECOGNITION OF PATTERNS IN DATA 



BACKGROUND TO THE INVENTION 

S Field of the invention 

This invention relates to recognition of patterns in data. In particular, it relates to a 
system that allows an organisation to obtain intelligence from its data that is not 
available using conventional data management systems. Most particularly, it is suitable 
for recognition of pattems in data relating to an organisation's customers. 

10 Understanding data that is accumulated within an enterprise is both an art and a science. 
In many cases, there is information within the data that is potentially of great value, but 
cannot be readily accessed. 

Traditionally, data relating to an enterprise was maintained in paper records, and 
automated analysis of it was not possible. Predictive analysis of data was typically 

15 restricted to reliance upon the knowledge of one or more persons and their subjective 
reaction to particular occurrences within the enterprise. While a suitably skilled person 
might be able to obtain predictive information from such paper records, it is not ideal. 
A company's fortune can be tied to the health and loyalty of a small number of 
individuals. Moreover, there is simply a limit to the amount of data that a person is 

20 capable of processing. Detailed analysis of the data collected by even a relatively small 
enterprise is beyond the capabilities of even the most exceptional person. 

A particular example is data that relates to the customers of an enterprise. All 
customers are unique, and to understand their motivations and behaviours at any given 
point in time, they need to be treated that as individuals. This is generally referred to as 
25 "customer relationship management" (CRM). A person can maintain an accurate 
assessment of a few hundred customers at most, and then only if they have knowledge 
of the customers' behaviours and preferences. Customer relations management for a 
larger number of customers or where customers' transactions are handled predominantly 



by automated electronic systems ceases to be a task for human analysts and instead 
becomes a technical problem that must be assigned to automated systems. 

Automated CRM systems are in a state of rapid and sustained growth because putting 
the customer at the heart of the business process is recognised as the most critical way 
5 to minimise chum: where customers desert their existing suppliers for new ones. 
Companies using such systems can, through developing a unique understanding of their 
customers, help them to realise more interesting, relevant and rewarding outcomes from 
their interaction with the company while simultaneously reducing costs associated with 
customer attraction and retention. 

10 There are many other data records that are routinely maintained by a company. For 
example, relating to production and quality management. In this context, predictive 
analysis of data can identify likely problems in production that could leas to a loss of 
quality before they occur. 

SUMMARY OF THE INVENTION 

15 Therefore, an aim of the invention is to provide a data management system that can 
obtain predictive information from a large database relating to past activities and make 
predictions as to future events from that data. It has as a special aim the implementation 
of a predictive technique in CRM that matches customers to items of potential interest. 
It is also an aim of the invention to provide a CRM system that has an interface design 

20 using key features of personal construct psychology. This can be achieved through a 
combination of logical entailment and fiizzy logic (fuzzy entailment) for inference 
modelling and self-leaming at the individual and group level. A combination of fuzzy 
entailment and inverse Mills ratio calculations with Tobit, Logit or Probit experimental 
modelling can produce self-leaming at the group and application level. 

25 This specification refers throughout to 'products' and 'customers' due to the immediate 
usefulness for generating improvements in customer satisfaction and client revenues. 
The terms 'items of interest' and 'users' are equally applicable. The system can be used 
by providers of products, services, events and so forth, and these will be referred to 
generally as 'things'. 



From a first aspect, this invention provides a data management system for managing 
data relating to customers and transactions, the system comprising an analysis engine 
for analysing relationships between responses made by a user to questions relating to a 
service or products, in which the analysis of responses made by a customer to one or 
5 more constructs. 

Such constructs, if carefully created, can generate detailed analysis of a user's opinions 
and preferences. 

It has been found that particularly advantageous can be constructed where the analysis 
involves a process of fuzzy entailment. 

10 Typically, each construct includes two distinct descriptive terms relating to things 
provided to customers by operators of the system. These should be perceived by the 
user as opposite extremes of a range of opinions about a thing. Therefore, the 
descriptive terms of each construct may represent contrasting opinions of the thing. A 
system embodying the invention typically obtains data from a user that represents a 

15 user's opinion of the thing in a range defined by the descriptive terms. 

Li typical embodiments, the construct is represented by visual control displayed in a 
graphical user interface on a computer screen. In such cases, the user can input a value 
representative of their opinion by adjustment of the position of the control. This 
provides visual feedback to the user of the value that they wish to input. 

20 The results of the analysis may be used to provide deduce which items of information 
will be of interest to a particular customer. 

In a typical configuration, a data management system according to any preceding claim 
executes on a server that communicates with a user over a network link, which will 
typically include the Intemet. Such a system usually includes a user data input 
25 component that executes in on a remote host system. For example, the data input 
component may be represented in the display generated by a web browser. To further 
increase the versatility of the system, the data input component may be generated by an 
applet that is downloaded to the remote host from the server. 



A data management system embodying the invention is advantageously able to process 
incomplete data. This is because, in many cases, a user may not input complete data 
either because the data is not available or simply through disinclination. Such 
incomplete data may be processed by matching those parts of the data that are present 
5 with characteristics of existing data. For example, the incomplete data may be subject 
to discriminant analysis. 

Since the system must deal with data that relates to opinion, it is necessary to represent 
the data in a linear, numeric manner. Therefore, in typical embodiments of the 
invention subject the data to a process of linearisation prior to analysis. It may be that 
10 the process of linearisation includes conversion of non-numeric data to a numeric form. 

Typical embodiments of the system are implemented as a computer software system. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a diagram illustrating the overview of a customer management process in an 
embodiment of the invention; 

15 Figure 2 illustrates the steps following construct elicitation and fuzzy entailment stages; 

Figure 3 illustrates recommendations derived from fiizzy entailment; 

Figure 4 represents the logical relationships among the entities within the application; 

Figure 5 is a graph that illustrates the relationship between the output of a fiizzy 
entailment fimction for a range of power and mesh values; 

20 Figure 6 is a diagram that illustrates the interactions between a user and various 
components of an embodiment of the invention; 

Figure 7 is a diagram illustrating the response management process in an embodiment 
of the invention; 

Figure 8 is a diagram that illustrates a simplified hardware implementation of an 
25 embodiment of the invention; and 

Figure 9 is a process diagram that illustrates operation of an embodiment as a whole. 



> 
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DETAILED DESCRIPTION OF THE ACCOMPANYING DRAWINGS 
Overview 

As shown in Figure 8, an example system embodying the invention is implemented in a 
system for carrying out electronic trading on the Internet 10. The system executes on a 
5 host 16 and is accessed from a web browser executing on a remote client computer 12 
communicating with a server 14 using hypertext transfer protocol. Networking 
apparatus 20, such as a load balancer and a firewall maintain a secure connection 
between the host 16 and the Internet 10. A user of the remote computer is therefore 
considered in this description to be a customer of the server's operator, and therefore a 
10 user of the system embodjdng the invention. When the system requires data to be input 
by the user, it can cause an applet to be executed on the remote system 12, the applet 
displaying data output and input objects with which the user can interact. 

INTRODUCTION TO THE TECHNOLOGY 

The technology underlying the invention will now be described in terms of a plurality of 
15 method steps performed by an analysis engine, with reference to Figure 1. 

The technique and methods described seek to enable inter-comparison and prediction 
between and for users of online supply services using fuzzy logical entailment. 

Personal Construct Theory 

The conceptual basis is that of "repertory grid theory" (RGT). This is often referred to, 
20 within the context of the present invention, as "personal construct theory" (PCT). As 
originally described, and commonly still practised in personal counselling, the analysee 
selects their own element set, uses these to generate their own personal constmcts and 
generates scores (usually on a numerical range of 1 to 5) for each constmct pair against 
each element. 

25 The process, whilst capable of being made fast and easy for the analysee, is neither 
intuitive nor easy for most people to do quickly. The constmcts generated are rightly 
called personal constmcts and require a degree of introspection which users require time 
to attain. Because each set of constmcts and elements may be different, particularly if 
the potential element set is large, there are considerable problems, both computationally 
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and semantically, in comparing grids of scores from different analysees. Given that the 
expected attention span of a typical Web user it is not great, it is not realistic to expect a 
user to participate in a full PCX procedure. To avoid these issues a strong variant is 
used for score elicitation in embodiments of the invention. 

5 Instead of an element set generated by the user, the system provides a reference element 
set provided for the specific domain of interest. A typical example might be the domain 
"Cookery Books" with the elements as a number of titles of concem to a retailer that 
have been selected to represent qualities of interest within the exercise and its place in 
time. 

10 Lastead of user-generated construct pairs, a reference set of construct pairs is provided 
by the embodiment. These are, in the steady state, tuned in response to more detailed 
interviews with selected users, possibly using more PCT-like techniques onscreen or via 
the telephone. 

These pre-supplied construct pairs (which may be true opposites - which is not 
15 necessary or even advisable in traditional PCT) are then used as the basis of a set of 
scores for the elements by the user. Thus, whilst repertory grid analysis normally 
requires that the user generates their own set of descriptors for some user or otherwise 
defined set of elements, user willingness makes this problematic and pre-defined 
descriptor sets would be used, tuned as required with fixrther user input from selected 
20 users. 

Construct elicitation 

Personal construct psychology seeks to capture individual perceptions of particular 
issues and the world in general in order to predict behaviour. With this in mind, 
repertory grid technique is used to elicit views on chosen products or services or 
25 features of either (known as "elements" or "items") using pre-determined or user- 
generated linguistic pairs (known as "constmcts"). The psychology considers that users 
will express views that pertain to things - and rank their personal perception of those 
things along a bipolar range A B, A and B being the linguistic pair. 

An additional source of data 



As discussed above, PCX is not an easy for a user to complete quickly. Therefore, not 
all users will complete PCT responses. However, it is most undesirable that data 
relating to those customers be abandoned since it is potentially useful. Customers who 
do not complete a PCT response can be included by the system by classifying them to 
5 the PCT generated groups using a pattern recognition algorithm. In this embodiment. 
Fisher Linear Discriminant Analysis (LDA) is a pattern recognition technique that is 
used to classify new users into known classes based on a flexible nxmiber of 
characteristics, such as demographic data, purchase history parameters and so on. This 
algorithm allows the pattem recognition to be performed in a computationally 
10 inexpensive manner, which is important for the scalability of the system. 

Statistical modelling techniques that attempt to relate the importance of various inputs 
(for example demographic characteristics) to outcomes (e.g., 'customer value' metrics) 
can be used to adjust the classifiers generated by the LDA, or to adjust the set of 
characteristics considered by the LDA. 

15 Learning algorithms (such as the perceptron algorithm) can be used to provide 
incremental adjustments to the classifiers derived from LDA when an increasing 
number of users complete PCT responses. 

Logical Entailment 

Logical entailment can be defined as 'a set of premises logically entails a conclusion if 
20 and only if every interpretation that satisfies the premises also satisfies the conclusion.' 
(Michael Genesereth; Stanford 2002). A strict interpretation of logical entailment in the 
context of this invention would require that a descriptor pair would logically entail 
another pair if the score set for the first were either the same or consistently greater than 
or lesser than the second. 

25 Since there are severe data problems inherent in user provided scores due to low 
volumes of scores and user reluctance the iterative mesh technique, to be described, is 
used to lower the data granularity so that comparisons can be made at a lower measure 
resolution. 



Fuzzy entailment (initial prediction and individual self-learning) 

Rankings are used to determine values for construing on chosen elements. Logical 
entailment is used to determine semantic relationships and probabilities based on the use 
of language, and fuzzy logic is employed to filter stronger degrees of entailment 
5 according to individual linguistic nuance. The resulting values are a set of entailments 
between constructs and between elements. 

Based on entailment values, constructs will begin to polarise into particular groupings, 
which in tvun will have particular user, and element, attachments. That means that 
customers and products begin to align to systems of construal in a fluid and dynamic 
10 way. Subsequent construct elicitation and fuzzy entailment will update these groupings 
and attachments so that customers and products may form stronger or weaker 
associations with particular construal systems over time, reflecting for customers, their 
own development, thinking and motivations and for products, the emergent and 
changing associations by the client's customer base. 

15 New product recommendations can usually be fed back to the user in the immediate 
term as a quick response mechanism. 

Grouping Based on Fuzzy Entailment 

Users with the same dominant construct, at exactly the same mesh resolution and level, 
form groups. 

20 This works once a few hundred PCT responses are collected. In the bootstrap period 
before this is achieved, it is more effective to dynamically group each user with others 
who have the same dominant construct within some threshold level of magnitude, and 
ignore the mesh level used to achieve it. 

Guidance on the implementation of PCT is given in Appendix A. 

25 Linear Discriminant Function Analysis 

As discussed briefly above, this embodiment can classify users who have not completed 
PCT responses into groups that have been derived from those who have. This 
classification is done using linear discriminant analysis (LDA). The basis for the 
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classification is a wide and flexible variety of characteristics, from demographic data to 
purchase histories, Recency/Frequency/Monetary value (RFM) metrics and so on. 

LDA considers the characteristics of individuals to be mutually orthogonal vectors, and 
the aim of the technique is to define hyperplanes that separate classes of individuals. Its 
5 main advantage over other classification techniques is that once a linear discriminant 
function is estabhshed it is computationally inexpensive to perform classifications. 

A mathematical representation of the analysis is given in Appendix C. 

Modularity 

LDA a good integrating technology because it is capable of classifying based on an 
10 arbitrary number of characteristics. Modules are developed that each contain the logic 
required to retrieve characteristics. Several standard modules will be developed to 
extract characteristics from cUckstream analysis, demographics and RFM metrics. This 
modular approach also supports the development of custom modules for client specific 
sources of characteristics. 

15 Linearisation 

An important aspect of the analysis is the linearisation of characteristics. For example, 
if an input to the analysis is an individual's age, this is already a linear input. However, 
if the input is, for example, an individual's occupation, this is considerably less trivial to 
lineeirise. One approach is to associate occupation with social gradings, these being 
20 easier to linearise, or to consider each occupation as being a separate digital 
characteristic. Separating characteristics like this is likely to have performance 
penalties in both background and, to a lesser extent, live stages, but may produce better 
classifications. 

Linearisation of PCT output 

25 Although the initial clustering from the PCT analysis uses a "fuzzification" process to 
make discrete the construct entailment, for the LDA best resolution is gained by using 
the original continuous value of the entailment. 



Opportunities for Integration 
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Linear discriminant analysis does not attempt to relate which of the characteristics 
known about an individual are causative to a particular outcome, nor to provide insight 
into how similar users might be. As such, it is not capable of self-seeding (clustering), 
or of tuning itself further. This allows a harmonious integration with the fuzzy 
5 entailment technique for clustering users, and with statistical techniques (Probit and 
Logit analysis, for example, as described below). This is used to determine which 
characteristics determine which outcomes. Such statistical techniques can be used to 
tune the LDA function by altering the set of characteristics considered in the function, 
by including the characteristics found to be important, and excluding the imimportant. 

10 There is also an opportunity to use a leaming algorithm to adjust the LDA on the basis 
of each new user who completes PCT responses (rather than completing a full LDA 
again, or waiting until you reach a critical batch size). 

Post-construct modelling (prediction analysis and application self-learning) 

This stage uses statistical modelling to determine the impact of predictions and 
15 recommendations on purchasing behaviour. By analysing the strength of 
recommendations and the outcomes of activity using this system embodying the 
invention, the application assesses the degree of influence that recommendations are 
having on both purchases and purchase amounts. It then extrapolates to determine if 
marginal effects may improve the rate of convergence from recommendation* to 
20 purchase. 

The added benefit from this is that marginal effects analysis from recommendations 
may be used to second-guess the influences and behaviour of those who have not used 
the system, or who have used the system but received no recommendation following 
data input. Although repeat users of the system are less and less likely to ever get a *No 
25 Recommendation' assessment, the valuable feature of this mechanism is that the 
application ensures the inclusion of the widest possible user base which can benefit 
from its powerful predictive power. This is a powerful feature and one that may be used 
to promote greater customer coverage and engagement with the system at very low cost 
to the client. 
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Response management 

Shown in Figure 7, this stage sends suggestions to the customer regarding products of 
interest and to the company regarding the status of customers, products, and construal 
systems in operation among users (how products are perceived). Cumulative values are 
updated for products, customers and constructs as new data are input to the application. 
Response management continually updates the presentation of feedback to customers 
and clients based on this new data and/or intemal application self-learning, and handles 
all aspects of data storage, data retrieval, application coding and reporting. 

Configuration issues 

Systems embodying the invention are applicable to many different business situations. 
The system works basically with customer, product, construct and other 'objects*. 
Constructs, statistical modelling, recommendations, triggers, thresholds reports etc. are 
defined only through the use of the software. 

There are two basic types of user - the administrator and ordinary user. The 
administrator exclusively will be able to: 

• point to product, order, customer, construct and other databases as required; 

• define aliases allowing the use of any legacy system data to be used as required; 

• customise look and feel to suit company requirements; 

• choose reports; 

• delineate client-defined weighting factors where available; 

• define triggers for actions (e.g. level above or below which results considered 

important or actions taken); 

• define actions (e.g. trigger-defined results initiate commimications). 



Linking or registering data for the application 

Users, items, purchase histories (orders), and labels (constructs) all need to be 
recognised by the application. For users, a registration is required which captures basic 
data. Other demographics are usually available through the client's customer database 
5 and can be imported by the system from there. A complete breakdown of data 
structures and databases of this embodiment is detailed in Appendix B - Data Structures 
and Databases below. 

Customise look and feel 

The system is set up so that the administrator can enter company details, including 
10 HTML stylesheets, a picture field for a logo, and other client-produced templates with 
which the system can operate. In this way, the system can look and feel like an 
extension of the company's web site. 

Report Selection 

The administrator will be able to select from a list those reports to be sent or made and 
15 available or notified to relevant people within the client organisation or the customer 
base, as required. At least two e-mail addresses should be user-definable. Of course, 
one or both of these could be distribution lists. A minimum choice of report formats - 
HTML or TEXT - is available by default in this embodiment. 

A facility is provided that allows the client to define a text file for export to any client- 
20 maintained database. 

Defining triggers and thresholds for action 

Different companies using the system may wish to define their own trigger levels, above 
or below which an action is to be taken. For example, a company using the system may 
wish to receive an alert every time a customer moves into or out of the quintile group of 
25 those most likely to be disloyal to the company so that a particular chosen action can be 
taken. 



These triggers and thresholds are usually numeric values that act as filters during the 
response management stage. The user-definable triggers and thresholds are as presented 
in the following table: 



Stage 


Trigger or Threshold 


Comment / Report Reference 


Fuzzy Entailment 
Construct Entailment — 
User Attachment to 
Groups 


Trigger levels defined by 
client within configuration. 


Count of the number of constructs 
a user has used which also appear 
in the Strong Constmct Group at 
any point in time, then taking 
standard confidence levels (80- 
99% as set by client) above which 
recommendations are very likely to 
prompt (purchasing) action.. 


Fuzzy Entailment 
Strong Construct Group 


% value above which 
constructs are deemed to be 
entailed enough at the 
cumulative level (over many 
users' input) to constitute a 
strong grouping. 


The difference between these 
values constitutes the Weak 
Construct Group 


Fuzzy Entailment 

No Construct Grouping 


% value below which 
constructs are not deemed to 
be entailed enough at the 
cumulative level (over many 
users' input) to constitute a 
grouping. 


Fuzzy Entailment 
Strong Element Group 


% value above/below which 
elements are deemed to be 
entailed enough at the 
cumulative level (over many 
users' input) to constitute a 
strong grouping. 


The difference between these 
values constitutes the Weak 
Element Group 


Fuzzy Entailment 
No Element Grouping 


% value below which 
elements are not deemed to 
oe entaiiea enougn at me 
cumulative level (over many 
users' input) to constitute a 
grouping. 


Fuzzy Entailment 

Element Entailment - 
Strong Recommendation 


% value above which degree 
of entailment is high enough 
to make strong 
recommendation 


Together, these trigger values 
constitute application's Fuzzy 
Entailment Reconraiendation Rule 
(FERR). The difference between 
these values constitutes Element 
Entailment - Weak 
Recommendation- 


Fuzzy Entailment 
Element Entailment — No 
Recommendati on 


% value below which degree 
of entailment is not high 
enough to make weak 
recommendation and so no 
recommendation is made 
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Stage 


Trigger or Threshold 


Comment / Report Reference 


Post-Construct Modelling 
RFM Values for 
Customers 


Quintile split of customers 
according to their RF values 
(RFM if we can get the 
Monetary value of recent 
purchases easily enough) 


This is an internally used report 
that provides individual customer 
RF values for use in Post-Construct 
Modelling AND a quintile split of 
those values ranked in descending 
order. The result is 5 groupings 
with which we can work. 


Post— Construct Modelling 
Purchase Influence 


Degree of Influence above 
which outcome from 
recommendation on purchase 
is 1=YES 


These thresholds will affect the 
intemal analysis of performance. If 
set low the application will appear 
to have a greater influence on 
purchasing decisions, and indicate 
the need to narrow the search for 
marginal effects. 


Post-Construct Modelling 
Purchase Amount 
Influence 


Degree of Influence above 
which outcome from 
recommendation on purchase 
eimount is 1=YES 


Response Management 
Number of Days to 
Purchase 


Trigger value for the number 
of days after a 
recommendation is made, 
beyond which the influence 
of the recommendation can 
no longer be seen to be 
significant 




Post-Construct Modelling 
Marginal Effect Threshold 


Value above which a 
marginal effect is deemed to 
be significant in influencing 
purchasing decisions 


Default is 80%. 


Post-Construct Modelling 
Proximity Coefficient 


Value above which a 
customer who has not 
received recommendations 
from the system is deemed 
sufficiently likely to receive 
relevant recommendations 
based on marginal factor 
proximity to those who have 
received recommendations. 


Default is 80%. 


Response Management 
Customers About to Chum 


Lowest quintile to be 
reported in ascending order. 


This is the following calculation: 

RFM value*IMR value*Tobit 
Value (or Logit or Probit 
depending on experimentation 

[used) 



Table 1 - Trigger and Threshold Values 



Defining Actions 

• Once triggers have been defined, actions need to be associated with these. The 
following actions will be available: 
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• select from list of e-mail templates (produced by company) - may be based on 

trigger type 

• send e-mail of selected template to customer/customer group at e-mail 

address/distribution list 



• send e-mail of selected template to individual/group at company 

• Select from list of HTML templates to act as user's personalised homepage 

• Select from list of HTML templates to show as company reports 

• provide immediate on-screen feedback of HTML template X, Y, Z (X, Y and Z 

types will be determined through configuration, and associated content by 
trigger type and value) 

• pass data for further processing or storage 
Output formats 

The following tables are examples of output from configuration and registration. 

Company Name 
Company details 

WebSite (constant, URL format) 
Other company details 

Administrator Names 
Administrator IDs 
Administrator passwords 
Administrator passphrases 

Table 2 - Client (Owner) Registration and Security 



Users (Customer) Database location + reference + views + aliasing + 
links 

Items (Product) Database location + reference + views + aliasing + 
links 

Order Database location + reference + views + aliasing + links 
Labels (Construct) database location + reference + views + links 
Userslabels data storage 
UsersItemsLabels data storage 
UsersLabelsEntailments data storage 
Users ItemsEntailments data storage 
CumulativeUsersLabelsEntailments data storage 
CumulativeUsers ItemsEntailments data storage 

Recommendations database location + reference + views + links 
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Trigger/Threshold data storage ■ 

Table 3 - Configuration 

ID (link item, name of user, pointer to database record) 

Last purchase {Element, product ID, link to order database) 

Last purchase amount (Element, product amount, link to order database) 

YES/NO if this last purchase is stored as a recommendation to the user 

List of customer IDs that have not used the system to date 

List of customer IDs where *No Recommendation' has been returned on last 

visit to the system 

Table 4 - Customer, Product and Order Loolcups 

RFM refers, in order, to recency (number of days since last visit to site), frequency 
(number of visits to site in last 30 days), and monetary value of purchases in last 30 
days not including this visit. 'Response to recommendations' is a requirement to get 
feedback on recommendations as they are delivered from the fiizzy entailment stage. 
Not every system need implement capture of all of these items; indeed most will capture 
a subset of them, and some systems may capture other data at registration. 

Demographics (age/gender/occupation/marital status/hobbies etc.) 
What happened during the visit (day/ time /duration/ windows used/other 
pages visited/page from/page to/other goods recommended or purchased 
etc . ) 

RFM information on visitor 

Response to the recommendations during this visit (apart from purchase 
or not) - was the recommendation useful? Has user heard of /bought the 
element (item/product)? 

Purchase (s) amount (s) - individual values in an array of purchases in 
last 180 days, with flag if result of /linked to recommendation 

Table 5 - Customer Registration 

Processes in detail - Construct Elicitation 
Process Description 

Users are referred to the web applet provided by the system from various sources - for 
example, automated pushed e-mails, direct communication by company, advertising or 
word of mouth. As described in "CONFIGURATION ISSUES" above, a registration 
process and data linkage will be required. 
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This involves creating a web-based user interface that can present and capture data. 
Regardless of how users arrive at the first screen, the overall function of construct 
elicitation is to collect data firom users (customers) in an interactive and preferably 
entertaining way about the context of their visit/use of software and the things they wish 
to offer information about in retum for suggestions. Construct and element names, and 
numerical construct rankings for elements are key outputs fi-om this stage of the system. 

For a user, incentives to input data are based on benefits, for example, amongst other 
possibilities: 

• Immediate feedback 

• Client offers reward for taking part - prizes, reward points etc 

• Interesting process involved 

• Time saved in reaching concrete and relevant recommendations 

• Personalised homepage populated only with items of interest 

• Personalised feedback about their likes 

• Special offers 

• Confidential, fiiendly advice 

Consideration of the preferences of likely users of a specific implementation will help to 
ensure that the feedback given is perceived as truly beneficial and worth the 'hassle' of 
data input. 

A general context is asked for at the outset. This clarifies the top-level domain - for 
example, wine, books, CDs, or whatever product categories the client delineates. Using 
repertory grid methodology, users complete a triad task to elicit fi"om them how they 
perceive a group of products or services. From a predefined list of products (known in 
repertory grid analysis as 'elements'), users choose a minimum of three products and 
are then asked to select the odd one out. When a choice is made, the user is prompted to 
enter a word or phrase (known in repertory grid analysis as 'constructs'), which explains 
why the user perceives that element to be different to the others. For the purposes of 
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this embodiment, a minimum of three elements ranked using three constructs is 
required. 

The opposite pole to the word must also be elicited and is often not straightforward. 
Consider an example in which the system is to investigate perceptions of books. If a 
5 user describes Lord of the Rings as 'heavy' then the opposite might be 'light', but this 
could mean either actual weight of the book or the type of read it is perceived to be. So, 
the system must encourage clarity so that the opposite of 'heavy' might be *easy to 
carry around' or *light in weight' or, alternatively, *short' or *easy to read'. The point is 
that different people use language in different ways and to avoid confusion at this early 
10 stage a construct repository is configured by the client to help their users clarify the 
meaning behind constructs. Over time, this can be added to with user-generated 
constructs. 

A radio button or checkbox is used by the customer/user against the construct pole that 
they see generally as more positive in their mind. 

15 Using the initial construct chosen by the user, the system then gives the user a list of 
elements (products) in the same product category and asks the user to choose as many 
as they wish to rank in terms of the construct that they chose. Ranking is carried out by 
simple slider controls. 

The key to the data entry is that it should be simple and quick. The immediate feedback 
20 that will follow will be dealt with later. 

Embodiments may include a construct repository. If a user types in a new construct, a 
useful supplement is to have a keyword or linguistic matching procedure to offer the 
user the ability to choose an existing construct based on what they have typed in. Both 
poles of the existing construct are shown so that the user can decide if this is the bipolar 
25 distinction that he or she was thinking of. 



The following is an example of a single construct: 
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Table 6 - Basic 1x10 Grid 
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Ri - Rio are the ranks for each element according to the construct given. Less than 10 
elements may be chosen, but the minimum requirement is three. 

On this simple example grid, elements can be correlated to discover if there are any 
5 statistically significant groupings that would indicate that, for this customer, a group of 
products were perceived similarly in terms of this construct. 

Generally, grids are better if there is more than one construct as it is possible to 
correlate constructs in relation to an element i.e. show that for a particular product, two 
constructs are suggested as linked. For example, consider the following grid, which 
10 looks at a general perception of computer manufacturers: 





Elements 




DELL 


PANRI 
X 


COMP 
AQ 


TIME 


DAN 


TOSHI 
BA 


VIGLE 
N 


GATE 
WAY 


ICL 


IDEAL 


[Well Made 


Ri 


R2 


R3 


R4 


Rs 


R6 


R7 


Rg 


R9 


Rio 


Unreliable 


Made in Britain 


Rii 


Rl2 


Rl3 


Rl4 


Rl5 


R16 


Rl7 


R18 


Rl9 


R20 


Imported 



Table 7 - Example 2x10 Grid 

It may be that a cluster analysis shows a higher order correlation between reliability and 
imported products for this customer. With more constructs, further correlations may 
15 emerge also. 

To elicit further constructs the software allows a user to enter up to a maximum of ten 
(most users will never get near this number). There has to be at least three constructs 
elicited to meet the requirements for fuzzy entailment. A loop is offered whereby the 
user is offered the choice to perform the triad task with a different set of elements (this 
20 can be a different range of products under a different product category if required). The 
more that the system can capture data when a user is enthusiastic and motivated (say, by 
incentives like prizes or other rewards) the more the application can capture at that 
point. Note that the application works with whatever it is given, and if blank data fields 
exist, this is taken into account in workings. 

25 The following are examples of outputs from construct elicitation 

Context (Domain) (link item, pointer to database record) 
ID (link item, name of user, pointer to database record) 
Date stamp (variable) 
30 Time stamp begin (variable) 
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Time stamp end (Variable) 

Elements (Product ID, link item, pointer to product database) 
Construct (Text string, link item, pointer to construct pair) 
Construct owner (Client [done through configuration] OR 
5 user-generated) 



Data Matrix: 

10 E elements by C constructs (elements and constructs already defined 
above ) 

E * C data elements of numeric format 2 decimal places, a 101-point 
scale which can be expressed as fraction or integer. 

15 Note: the MINIMUM is a 3*3 Matrix 



Fuzzy Entailment 

Taking our example from Construct Elicitation, let us say that a 3x3 matrix like the 
following one has been produced following a single user interaction: 

20 
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Table 8 - Rankings from Construct Eiicitation 



Ranking values are greater if the user slides the 'volume control' slider further to the 
right of the screen, so that a value of 72 for a particular element is nearer the right hand 
pole of the constmct than the left. A marker indicates if one pole of the construct is 
25 more positive to the user than the other. 

For fuzzy entailment, a software procedure will inspect the matrix and produce a set of 
entailment values. The way it does this is as follows: 

Say a 3x3 grid is output from Construct Eiicitation thus: 



Element A Element B Element 

Construct X 72 40 32 

Construct Y 50 35 20 

Construct Z 68 42 25 

30 Table 9 - Raw data from Table 3 
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If we look at the relationship between constructs in terms of entailment - the extent to 
which relationships between row X and other rows look to vary in similar ways - over 
constructs (down the table) and elements (across the table) then we can use a fuzzy 
entailment algorithm (FEA) to work out such values. This works by looking not only at 
5 the entailment among elements and constructs, but also by filtering the inferential 
values by using fiizzy logic to determine primacy. 

So, first taking constructs and how they relate, we would oppose Y and Z with 

themselves to attain the following table: 

Construct X Construct Y Construct Z 

Construct X 100 60 45 

Construct Y 60 100 70 

Construct Z 45 70 100 

Table 10 - CxC Table (example FEA values given) 

10 Using the FEA, we can say that, for example: 

• There is a relationship between X and Y at about 60% entailment 

• There is a relationship between X and Z of about 45% entailment 

• There is a relationship between Z and Y of about 70% entailment 
Negative values may emerge as direction indicators between constructs. 

15 To look at Elements by rows, we have to tum the table on its diagonal to reverse: 

Constructs -> Construct X Construct Y Construct Z 

Element A 72 50 68 

Element B 40 35 42 

lement C 32 20 25 



Table 11 - Table 3 (Flipped on its Diagonal) 

We now oppose A, B and C with themselves to attain the following table: 

Element A Element B Element C 

Element A 100 55 75 

Element B 55 100 60 

Element C 75 60 100 



20 



Table 12 - E'^E Table (example FEA values given) 



Again, using the FEA method, we would arrive at the following example entailment 
values: 

• There is a relationship between A and B at about 55% entailment 

• There is a relationship between A and C of about 75% entailment 
5 • There is a relationship between B and C of about 60% entailment 

On constructs 

A construct repository is provided in this embodiment. Many constructs can be 
assigned to 'contexts' or 'domains' as required. Constructs are the richest source of 
identification for both users (customers) and elements (products), since they are the 
10 'glue' that binds them. 

On fuzzy entailment 

In order to ameliorate the constraint in deriving much more data about the semantic 
value of constructs from users directly, logical entailment is used to cross-match and 
confirm the semantic use of constructs. Fuzzy logic is used to filter from data input the 
15 use of linguistic scaling ('very', 'not very', 'quite', 'extremely' etc.), and thereby act as 
an important qualifier for entailment, ensuring that the significance of entailment 
receives preliminary validation at this early stage. 

In order to form groupings of constructs, entailment values for each user are then 
processed through a second set of algorithms that allow both constructs and users to be 
20 grouped. These groupings are dynamic, in that they change as new data is input by 
users. Likewise, groupings of elements take place so that those that form stronger 
bonds with others through the combined element entailment values derived from users' 
input, can be recommended to users with a degree of confidence that those users will 
like them/want to buy them. 

25 So, to sum up, the fiizzy entailment stage allows us to do the following: 



Store entailment values created for later use; 
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• Look for existing constructs that linguistically and semantically match the words 

or phrases input by the user as their personal construct(s) (logical 
entailment); 

• Apply principles from fuzzy logic to inspect and report the degree to which 

entailment occurs; 

• Report immediately to the user strongly entailed elements (product 

recommendations) indicated by their use of constructs; 

• Create and maintain dynamic groupings of constructs and elements to which 

users have an on-going association, which may strengthen or weaken over 
time depending on individual and total user community input. 

• Through multiple interactions from a single user, create a cumulative coefficient 

to represent the relationship between the user and both construct and element 
groupings, such a coefficient indicating the degree of association at any one 
point in time between the customers, construct systems and products; 

Outputs from Fuzzy Entailment 

Thresholds for belonging to a group are set in system configuration so that above/below 
the threshold it is possible only to say that an element or user belongs or does not 
belong (however temporary this belonging might be) to a particular super ordinate 
construal system. 

1 . Stored fuzzy entailment values for each construct pair and all elements from an 

individual interaction from the user; 

2. Construct groupings based on cxmiulative (i.e. from all individual interactions to 

date) entailment values between and among constructs; 

3. Degrees of association between and among elements based on construct 

groupings; 

4. Degrees of association between and among users based on construct groupings; 

5. Direction of entailment on each of the above values; and 
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6. Flags against entailment values lower, equal, higher than designated trigger 
value or recommendation rule set in administrator configuration. 

In typical face-to-face clinical sessions where repertory grid technique is used to ladder 
i.e. explore the "hows and whys" of constructs, users are offered the chance to review 
5 their input, reflect on the results and change values associated with correlations based 
on that reflection. For implementation, users will be allowed to manually overwrite 
presented simple correlations/regressions using a simple slider scale, should they so 
wish. A future development of this invention is to allow more profound laddering, 
should the user wish to gain from a more refined knowledge pool. 

10 The values for entailment are stored, and used to calculate cumulative entailment values 
over time. 

A further development of this application is to allow user-generated constructs to be 
incorporated into the application. This is quite simple but requires further work on 
interface and data posting. 

15 Post-construct modelling 

Evaluation of Construct Elicitation recommendations 

This part of the application has two main objectives. First, it measures the outcomes 
from construct elicitation (CE) and fuzzy entailment (FE) recommendations and 
compiles some simple preliminary statistics, which are stored in a database for further 
20 analysis. Secondly, it combines the recommendations with demographics and other 
data available through registration, web statistics and user feedback to calculate the 
association between the purchase outcome (did the user buy the recommended item or 
items) and all other explanatory variables available. 

The steps following construct elicitation and fuzzy entailment stages are shown in 
25 Figure 2. 

Recommendations generated through fuzzy entailment, and fed back to the user through 
response management, will either lead to a purchase or not. When the recommendation 
is given, the user is asked for feedback, such as: was it useful, have they knowledge of 
the recommended item, would they like more recommendations (at a weaker entailment 



level) and so forth. Fuzzy entailment allows ordinal ranking of entailments so that users 
can be split into those receiving strong or weak recommendations. To evaluate the 
effect of this * treatment', a post-construct modelling stage runs a probit where LHS data 
is recommendations strength (1 = strong, 0 = weak) and the RHS data consists of all 
5 available demographic, site visit and feedback data as outlined previously. 

An inverse Mills ratio (IMR) is derived from this probit. A subsequent probit is run that 
has LHS data being purchased recommendation (1 = yes, 0 = No) and RHS data being 
demographics, visit attributes, user feedback responses and the previous IMR. The 
significance (and sign/direction) of the IMR signifies whether the recommendations 
10 made to customers influence purchases and if they are made to the right users visiting 
the web site. 

This firamework can be readily extended to incorporate several levels of 
recommendation strength up to a maximxun of, say, 5 if required. In the example used 
here 100 values produced through fuzzy entailment have been taken, from which 64 
15 have produced some form of recommendation - strong or weak. Those 64 responses 
are the basis of the data set described in Appendix A below. The system is able as a 
result of this first stage of post-constmct modelling to assess the influence that a 
recommendation has on: 

• the decision to purchase or not purchase as a direct consequence of the 
20 recommendation being made; and 

• the amount of the purchase made. 

At this point we are thus in a position to evaluate the efficacy and accuracy of 
predictions from fuzzy entailment, and quantify or rank those customers in terms of the 
degree of influence the recommendation has had on the amoimt of money that they 
25 spend. Self-leaming at the application level begins to take shape here, because this 
internal process effectively derives data which effects checks and balances within the 
system. 

In this embodiment, a minimum of 200 purchases from recommendation is required 
before the process can begin. 
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Modelling marginal changes 

The second step in post-construct modelling for self-learning purposes can take several 
directions and is dynamic in this respect. At this point we have a view as to the direct 
impact of some intervention or characteristic of the customer and their indirect impact 
5 through recommendation strength. Note that in Step 1 of the Post-Construct Modelling 
example below, the sample excludes those who received no recommendation, yet the 
system still has registration and other data available about them. 

We can now extend an analysis to those who received no recommendation at all. 
(Fuzzy entailment cannot guarantee that all visitors will receive at least one 

10 recommendation, although over time fuzzy entailment self-learning means that this is 
less likely for repeat users). The system can predict outcomes by generating 
recommendations for them based not on their construct elicitation responses but on their 
demographics. This is not guaranteed, but is a way of picking up those users who have 
taken the time to use the system and have not generated significantly strong entailment 

15 values to have been recommended anything of interest at the fiizzy entailment stage. 

Therefore, in effect the system is able to learn from fuzzy entailment, and self-correct to 
ensure that it can provide a double-check prediction for 'no recommendation' users. If 
significant marginal effects emerge, the system will attempt to identify customers who 
have not used the system, but exist within the client's customer database in order to 
20 select appropriate recommendations for them too, based on users' proximity coefficients 
(the degree to which a user is proximal in profile to those who have received 
recommendations and made purchases and likely to exhibit similar behaviour). 

Simulation techniques are used at this point to further enhance self-learning capability at 
the broader level. A series of predictions are run that give the marginal changes that can 
25 be expected if any recorded information at the system's disposal were to change. It is 
possible to ask at this stage: 

• How will purchases be affected if threshold values for strong/weak or other 
categories of recommendation change? 
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• Are there characteristics of weak and strong recommendations that could inform 
groupings? 



♦ 



• What generic user profiles emerge as those most likely to buy following 
recommendation? 

The experimentation possible via simulation at this stage allows us to extrapolate to 
larger-scale models. The application analyses purchasing behaviour of the new 
5 recommendees to accumulate application knowledge about the performance of this 
marginal recommendation mechanism. Various statistical modelling techniques are 
available to the application and it will choose which one to use depending on the level 
of conversion from recommendation to purchase among different customer groups. The 
aim is to increase purchases among non-users of the system or increase the nvimber of 
10 users. If either of these trends is moving upward then the application is improving its 
performance over time. 

A worked example is shown in Appendix B. 

The application generates lists of: 
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1. 'high performance' customers likely to cross-purchase - from results of 
reconmiendations combined with demographics to indicate likelihood of 
high lifetime value (LTV) to the client; 



2. 'low performance' customers likely to chum (leave) - from results of 
recommendations combined with demographics to indicate likelihood of low 
LTV to the client; 
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3. customers who have received no recommendations from their use of the system 
or who have not used the system, but who proximate to profiles of defined 
high LTV customers above; 
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4. customers who have received no recommendations from their use of the system 
or who have not used the system, but who proximate to profiles of defined 
low LTV customers above; 



5. recommendations that went to high LTV customers, for sending to profiled 
'marginal' customers; 



6. marginal effects statistically influencing purchasing behaviour; 
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7. recommendations from fuzzy entailment that strongly influence purchasing 
decisions and amounts. 

The following are examples of outputs from post-construct modelling: 

5 - For each customer. Value 1=YES, 0=NO: Do recommendations 

influence whether purchase is made or not ; 
For each customer. Value 1=YES, 0=NO: Do recommendations 

influence the amount of purchase or not; 
For each customer. Value 0-1: Degree to which recommendations 
10 influence whether purchase is made or not; 

For each customer, Value 0-1: Degree to which recommendations 

influence amount of purchase; 
For each customer, list of marginal factors that significantly 
(see "defining triggers and thresholds for action") influence 
15 strength of recommendation, purchase decision and purchase 

amount ; 

Filtered, ranked list of customer IDs for whom recommendations 
do influence purchase decision to a strong deg-ree (see 
"Defining triggers and thresholds for action) AND do 
20 influence purchase amount to a strong degree; 

Filtered, ranked list of customer IDs for whom recommendations 
do influence purchase decisions to a weak degree AND do 
influence purchase amounts to a weak degree; 

Filtered ranked list of customer IDs for whom recommendations do 
25 not influence purchase decision AND do not influence purchase 

amount ; 

Coefficient for each user indicating degree of correlation 
between demographics, registration data, website visit 
statistics, and user feedback to recommendations to strength 

30 of recommendations themselves; 

Coefficient for each user indicating degree of correlation 
between demographics, registration data, website visit 
statistics, user feedback to recommendations etc. to purchase 
decision and purchase amounts; 

35 - List of high value co-efficient users/customers for whom 

correlative values indicate that, even though they have not 
received recommendations through the system, can receive the 
suggestions that others have received who have used the 
system (in effect these will be the people who benefit from 

40 this stage of the process but who may not have benefited 

through Fuzzy Entailment) . 

Profiling is achieved through the concatenated array values for the above, equally 
weighted. For example, 1, 1, 0.42, 0.65, o! 0. L 1.0 . 1, 0.72, 0.67, 0.45, 0.613. Note 
that the last figure is the average of the penultimate three coefficients. The underlined 
45 figures represent five marginal factors with 1 = "influences" and 0 = "does not 
influence". The unweighted total of this array is the sum of the individual integers, hi 



fiirther embodiments of the invention, weightings may well become necessary, at which 



29 

point this will become a feature of configuration i.e. each index value defined above 
will be multiplied by a 0-100 weighting value. 

Groupings at this broader level are restricted to quintiles, with concatenated values 
providing a measure not only of the influence of fuzzy entailment recommendations on 
5 purchasing but also of the influence of marginal effects. The upper quintiles represent 
customers to whom 'mirror' recommendations can be made based on the 
recommendations targeted at users of the system with similar profiles. 

The list of significant marginal customers is available as a report to the client, and to the 
system, which can then track any subsequent usage of the system. (An advantage of the 
10 system is that, through this extrapolation technique, it can attract those who have not 
used it directly.) 

Performance management is achieved through self-adjustment. This is done by keeping 
dynamic listings of high, and low, LTV clients within the system database (including 
link IDs to the customer database marginals). Customers that fall within upper quintiles 
1 5 act as models against which others are compared, thereby creating an on-going and self- 
leaming performance regime in which the characteristics and construal systems 
associated with strong or weak bonds, purchasing or non-purchasing, amounts of 
purchase and marginal effects on purchasing are constantly acting as referencing tools. 

Where recommendations are repeatedly failing to lead to piu-chase decisions, or perhaps 
20 low purchase amounts, the application forces an increment in accuracy so that 
thresholds for action become higher to improve the level of confidence with which 
reconunendations are given. This can be overridden within the options for 
configuration. Where recommendations are strongly influencing purchase decisions, 
the opposite happens, so that the threshold for action on the promotion of a specific 
25 product or item reduces to cover a broader range of customers. 

While the application self-adjusts with acciunulation of data and knowledge, clients 
may wish to take advantage of the reporting mechanisms available in order to keep 
abreast of such dynamic performance measurements. In essence the data and statistical 

values generated are utilised to form 'cumulative intelligence' on customers and 
30 products, which can be hamessed by the client for key aspects of the business. 
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RESPONSE MANAGEMENT 
Cumulative Intelligence 

From this data, the system can be used to show (among other things): 

• anticipated general customer reaction to a product or product range; 

• dynamic customer groupings; 

• prediction of customers that may switch to another suppUer; and 

• easy-to-read 'predictive' league tables of products and product ranges. 
Process Description 

At the point of entry to this stage of the system we have all the previous data plus the 
results of the statistical modelling: 

• Updated cumulative entailment values for all elements in range; 

• Updated cumulative entailment values for all constmcts elicited; 

• Group associations based on these entailments; 

• Calculated IMR values (degree of influence of recommendations); and 

• Calculated tobit values leading to predictions on marginal effects of collected 

data (attributes other than entailment values impacting significantly on 
purchasing decisions). 

Response management is used following each stage of analysis. Following fuzzy 
entailment, users receive a set of recommendations based on their input. This is a quick 
response mechanism and is the primary source of value for the user. The quick 
response can, however, be presented to the user in several ways. An HTML page 
carrying suggestions for items of interest will appear immediately after data input has 
been completed. For users who use the system more than once, we will offer the 
opportunity for them to have a personalised web page that acts like their own 'store'. 
This will not exclude any news, offers, promotions and client-defined requirements, buf 
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will contain a unique set of items of interest depending on the individual. Unique 
because these recommendations will be updated as new data from other users, 
predictions, evaluation and marginal-effect modelling all act to update cvunulative 
entailment values, group associations, influence factors and both user and product 
5 rankings relative to others. 

Once a series of predictive indices has been produced for products, product groups, 
customers and customer groups, the next stage in the process involves: 

Look up the TRIGGER or THRESHOLD value(s) for entailment, group associations 
and degree of influence and marginal effect, and retum values depending on whether 
10 they equal, surpass or fail to reach that value: 

• Posting data to relevant locations 

• Updating existing data where necessary 

• Using logical conditions (IF, THEN etc.) to determine actions 

• Providing INSTANT feedback to the user 
1 5 • Providing REPORTS 

• Executing intemal self-checks and balances 

• Executing actions based on given parameters configured by administrator 

The logical conditions for action are most tjqjically a mix of pre-determined statements 
and user-defined triggers/thresholds and decision models. 

20 A pre-determined statement might be "IF element x is entailed with 
element y at greater than 0.7 THEN classify as a 
significant pairing". In this example, the fact that the pairing is nominated 
might be because this is a fundamental principle of statistical modelling and should not 
be modifiable by the end user 'administrator'. 
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A user-defined trigger or decision might be ^^ONLY show customers 
significant pairing elements that have an entailment value 
within 7 0 % ± 5 % " . This allows the client to fine-tune the accuracy of the predictors. 

Finally in this section is the important subject of reporting. For users of the system, 
reports split into: 

• Those for customers; and 

• Those for client/company (software licensee) 

In addition, there may be maintenance and technical reports provided in order to aid 
troubleshooting should any problems arise. 

Recommendation from fuzzy entailment 

This works at two different stages of the application's cycle. First, after fiizzy 
entailment has produced strong or weak entailments between and among constructs and 
elements, recommendations are fed back according to groupings formed through this 
stage. A simple set of recommendations might arise as will be described with reference 
to Figure 3. 

Figure 3 above shows how a customer using constmct A can be recommended elements 
A and C based on the strong entailment between constmct A and constmct C, even if 
construct A has not been used to rank elements A or C. 

Looking at constract A and element A in the diagram above it is worth noting that both 
constmcts and elements have differing degrees of entailment among themselves, so 
membership of groupings is not exclusive, and as values change with cumulative and 
longitudinal data gathering, these groupings will be dynamic in nature. This allows the 
possibility of suggesting new items (elements) to users even though they have not 
engaged with the system to enter any new data. Although this tends to assume that the 
user's constract system has not changed in the intervening period, this may be more trae 
in an Intemet environment where relatively short customer lifetime values are cormnon 
and therefore less time exists within which to have major changes of super ordinate 
constmct systems. 
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Recommendations at this stage represent both an inmiediate response to users engaged 
in data input and an ongoing dynamic recalculation of cumulative entailment values 
between and among constructs and elements which leads to triggering of new 
recommendations by e-mail, HTML homepage updates or even via alerts to mobile 
5 devices. 

Recommendatioii from post-construct modelling 

Recommendation at this stage involves assessment of the degree of influence on 
purchasing behaviour among the population of users of the system receiving strong 
recommendations, and to analyse customer profiles in this group to assess the 

10 possibility of making new recommendations to those who have not used the system and 
those who have received no recommendations, based on the combination of the effects 
of recommendations and of demographics, feedback, RF values and web activity. The 
format of the recommendation presentation will differ from that of fiizzy entailment in 
that these customers listed by Kostas may not know about the system and require some 

15 explanation of why they have received recommendations. Clearly, one of the objectives 
here is to help engage customers as much as possible in the usefulness of 
personalisation and the system in particular so this mechanism is used as a 'recruitment 
drive' for new users of the system. 

Report possibilities 

20 Individual and cumulative predictive coefficients for customers, products, customer 
groups, and product groups may change as new data is entered, yet at any one point the 
client can see a snapshot of a series of probabiUties, as follows: 

For the customer: 

Report Type A: General, Individual Customer Ranking 

25 The overall likelihood that a particular customer will be loyal and show an interest in 
existing or new products 



Either: 
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This is the top-level performance indicator and relates to existing customers only. It is a 
calculation of purcheises made following recommendations, RFM values and responses 
to recommendations. It takes the form of a league table, with only those customers with 
very low values shown. At a very basic level this is the AVERAGE value 0-1 of: 

5 

• 0-1 value: number of purchases/number of recommendations 

• 0-1 value: RFM calculation 

• 0-1 value: number of times the user has responded positively to the question 

*is this recommendation usefulVnumber of responses made to 
1 0 recommendations ; 

• User-defined weighting factor. 

Or: 

• The average of the cumulative entaibnent values for ALL elements looked at 

and ALL constructs elicited for a particular customer; 
15 • Proximity to the upper quintile of the normal distribution of these values 

across all customers (where the customer sits relative to other 
customers); 

• a reliability or 'performance' factor based on post-construct modelling; and 

• a user-defined value or weighting factor, set up by the administrator or 

20 imported as part of the initial configuration, which may act as a simple 

ranking measure of an existing customers status with the company 
(useful if a company wishes to add their own factors based on their 
specialised knowledge of the customer, or use a value firom an existing 
customer database such as ranking scores). 

25 Report Type B: Dynamic Customer Groups 

Customer Groupings based on different customers' construct systems 

This is a measure of the degree of association between users in terms of multiple 
characteristics: 

• Degree of association to strong, or weak construct systems 

30 • Degree of match between customers with similar values for the influence of 

recommendations on their purchasing behaviour; 

• Degree of match between customers with similar marginal effect ratings i.e. 

those that differ due to similar marginal effects such as particular 
demographics or responses to feedback questions; 
35 • Existing degree of match through client customer rankings/' client' -defined 

weightings 

For Products: 



Report Type C: Individualised Customer * Stores' 
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New products that will interest a particular customer 

This is similar to the fuzzy entailment process but extrapolates to all product groupings 
that may be of interest to a particular individual based on cumulative entailment values: 

• for a selected customer, all the elements and element groups which are 

calculated through the application to be of interest at the point of running 
the report; 

• Option to save a specific report for a specific customer for tracking over 

time; 

• of all those elements returned, a ranked list by cumulative entailment values 

of item (element) names categorised into strong and weak 
recommendations ; 

• A flag against each element already owned/bought by the customer. 
Report Type D: Actual Product Performance 

New products that will interest customer groupings 

Same as above, except that each customer grouping is used instead of a particular 
customer, and the report shows a ranked list of products in terms of: 

• the number of different groups that the element has been recommended to at 

a median level of 'strong recommendation'; 

• the absolute number of customers to whom the elements have been averaged 

as strong recommendations; and 

• The current ranking of that product according to client-defined 

characteristics. 

Report Type E: Predicted Product Performance 

Product performance predictions across the customer base 

This can be used where the client wishes to describe and show a new product/item to 
customers invited to use the system or already using the system, and use entailment and 
groupings to see which groups of customers are likely to wish to buy it. The list of 
known customers can then be targeted in a cost-efficient way. 

This is a league table that shows elements ranked according to: 

• The degree to which they have been bought as a result of recommendation; 

• The degree to which they associate through entailment groupings; 

• The nxraiber of customers to which these elements, though entailment and 

post-construct modelling, are likely to be recommended. 
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The system must provide a cut-off point for showing the table, perhaps again on the 
basis of a trigger values. In the conjBguration of the software, two values should be 
input for this kind of report - top ?i and bottom n elements where w is a user-defined 
value for the number of elements to be shown in the table. 

S Customer Reports 

Customer Reports are likely to be in the form of HTML pages with highlighted items of 
interest, information and latest feedback on their input to the system, as well as e-mail 
templates with special offers etc., based on triggers. 

Company Reports 

10 Here it is difficult as there is likely to be a pre-determined subset of report 'templates' 
that are modified according to user-defined triggers and decision models. On the basis 
of such reports, automated and manual actions may be taken. Reports will be split into 
the following categories: 

• Activity profiling 

15 o Levels of activity on the web application 

• Product profiling 

o These reports will concentrate on league tables of product ranges with 
the ability to drill down to individual products 

• Customer profiling 

20 o These reports will concentrate on league tables of customer groupings 

with the potential to drill down to individual customers if 
required. 

• Self-Learning Reports 

o Performance monitoring over time to see how well the application is 
25 performing in this aspect. 



• Technical Reports 
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o These will include error logging, configuration summaries (how the user 
has defined the triggers and decision models for the system) 
and other technical reports that may help in the maintenance 
and upgrading of the software. 

5 For automated actions, e-mail and HTML templates would seem the most efficient way 
of handling 'push' communications. This aspect of the system is important as it 
automates not only the process of market research but also directly links promotion to 
accumulated intelligence that anticipates future customer behaviour and product 
perception. 

1 0 Implementation of Fuzzy Entailment Analysis 

The object is to gather measures of the user's constmct structures in comparison to pre- 
defined constmcts so as to identify a set of users to which the user belongs. 

Considerable emphasis has been placed on the difficulties involved in comparing 
different users' construct sets and scores. Given the basis of PCT, as described above, 

15 they are not strictly comparable, since there is no guarantee that the constructs are being 
interpreted and used in the same way by different users. Accordingly, and accepting 
that this involves a departure fi-om traditional PCT techniques, in implementing the 
invention a choice has been made to pre-select the construct sets, these being 
deliberately chosen on the basis of trials to reflect the market segmentation which is to 

20 be examined; and to offer both pre-selected or user-selected elements so as to both 
minimise the time required for the exercise and to ease the comparison difficulties. 

The element set and constmct pairs (or singletons) are represented onscreen in such a 
way that the user can easily and quickly set the 'scores' that they apply to each 
constmct. Scores are indicated by a user placing a marker somewhere on an arbitrary 

25 length measure with a descriptor attached to each end of the measure. A typical way of 
doing this would be for a slider to be moved using a computer mouse or similar pointing 
device into the desired position on a progress bar, the bar being labelled at each end 
with one of the descriptors comprising the pair. Typically, the slider would be invisible 
until the mouse was above the progress bar to prevent the user being biased by 

30 observation of the initial, default position of the slider. A mouse event would confirm 
the scores. 
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The user is required to provide a mark on the bar representing their opinion (given the 
construct pair) of an exposed element. Traditionally in PCT, both the elements and the 
constructs would be generated by the user, but in embodiments of the invention, the 
implementer can elect to pre-provide both so as to enable the comparisons which will be 
5 made with the scores provided; and accepting that the advantages of cohort grouping 
and comparison outweigh the particular detail provided by individualised sessions. 

The arbitrary length progress bar is scaled to provide an initial so-called "mesh" from 
which the user's score(s) are read. Traditional PCT tends to use scales limited to a fixed 
range, for example a range of 1 to 5. This range of scores means that the mesh involved 
10 has the value 4, which is the largest difference in scores possible between two user 
inputs. The measure is coded to produce a defined prime mesh. This can be any mesh 
greater than 1 and up to any upper value required. Meshes greater than 10 do not add 
significant information and a typical initial upper limit might be 9. Scores are 
equivalently scaled to represent the score within the mesh as on the user's measure. 

15 The approach taken in embodiments of this invention is not to proscribe the scale in that 
way. For example, it may be assumed initially that the scale used is 1 to « - classified 
here as having a mesh of n units (again arbitrary). Practicalities suggest that an initial 
mesh of 9 (scores of 1 to 10) provides ample detail but there is no need to limit the mesh 
in that way. For instance, it might arbitrarily be set at 99 (1-100). 

20 It is worth noting that the mesh values described, unlike the example given for PCT, are 
all odd. Were an even-valued mesh to be used, a mid-point would be produced. 
Generally, it is preferred that users were not allowed to avoid giving a score by 
sheltering under the mid point. This is of greater importance as the mesh decreases, 
since the crudest mesh (that is, a value of 1) can providing a truth table of comparative 

25 scores. 

Analysis proceeds by setting the initial mesh high and seeking entailments between the 
descriptor pairs for the supplied scores. As the mesh is lowered, the precision of the 
measure decreases, but its comparative value increases. This is typical of rendering the 
data fiizzy, which is the result of the lowering mesh value, and is an important 
30 underpinning of the technique described. At each chosen mesh value, logical entailment 
is sought between descriptor (pairs). 
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The mesh is reducible to 1 as a lower limit. At this minimal level, the data set of scores 
against descriptor pairs is reduced to a binary value, such as "Yes" or "No" for each 
descriptor, allowing their representation in the form of a truth table and thence direct 
semantic reasoning. Entailments emerging would be of the kind having values 
5 designated "entails" and "does not entail", which are directly useful for data 
segmentation. 

For all other mesh values there is the possibility of a degree of entailment. Since 
entailments could emerge by chance, the fuzzy degree of entailment is used to express 
the power of the relationship. This can be scaled from -1 to 1, allowing for the positive 
10 and negative agglomeration function values described below. In embodiments of the 
invention, typical semantic pairs are conditioned by linguistic modifiers rather than the 
traditional 0 to 1 for fiizzy logic. 

The user is invited to provide several scores of the same construct sets against a number 
of elements. Again in PCT there is a tendency to expect score matrices of R constructs 
15 against C elements where R and C are expected to exceed 5. In that case the user is 
required to provide in excess of 25 scores (i? * C) and the time investment exceeds the 
expected time that users will provide for such an exercise online. 

Where a level of entailment is considered reportable, the entailment relationship and 
mesh (ER & M) are stored and compared against other ER & M values generated by 

20 other users using the same descriptor set. Since the element and descriptor sets are the 
same, whilst this is not in accord with traditional RGT due its impersonal nature, the 
reference sets are selected so as to be both generic and pertinent to the domain of 
interest, enabling direct comparison both with other such values within the same domain 
and with such values in conceptually related domains using the same reference set of 

25 constmcts. 

Scores matrix 

Assume a set of scores of three construct pairs (or single descriptors); Rj, R2 and R3\ 
against three elements Cy, C2 and Cj; chosen either by the user or pre-supplied by the 
system. This is represented in the 3 by 3 case as: 



30 
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Scores 


|c, 


C2 


C3 


Ri 


Hcl 


rlcl 


rlc3 




\r2cl 


flcl 


r2c3 


R3 


jrScl 


r3c2 


r3c3 



More generally the scores matrix can be expressed as Scores[lf, C\ with R rows and C 
columns. 

Processing algorithm (agglomeration function) 

5 A descriptive algorithm for the calculated components of the measures will be presented 
below. 

For Ro : = 1 to R - 1 
For Ri : = 2 to R 
NegTotal := 0; // Sums the number of -ve differences 

10 NegDistance := 0; // Sums the fn(S(-ve differences)) 

PosTotal := 0; // Sums the number of +ve differences 

PosDistance := 0; // Sums the fn(S(+ve differences)) 

SameTotal := 0; // Sums the number where the same 

SameDistance := 0; // Sums the sames, S =0 (strictly) 
15 For Co := 1 to C - 1 

If Scores [Ro,Co] <Scores [Ri,Co] 
NegTotal := NegTotal+1; 

NegDistance : = NegDistance+ fn (Scores [Rq, Cq] -Scores [Ri, Cq] ) ; 
Else If Scores [RO,CO] >Scores [Rl, CO] 
20 PosTotal := PosTotal+1; 

PosDistance : =s PosDistance+ (Scores [Ro/Cq] -Scores [Ri^Cq] ) ; 
Else 

SameTotal := SameTotal +1; 

SameDistance : = SameDistance +0// (strictly) 
25 Next Co 

Next Ri 
Next Ro 

The function /, is a distance function which, in the simplest case, is simply the 
difference between the two values, 

30 A typical statistical approach is to consider a distance function comprising the squares 
of these difference; (other power can also be used). The use of powers of 2 is well- 
analysed and understood in the context of best linear unbiased estimators (BLUE), but 
that is not to say that the techniques described herein are necessarily BLUE or satisfy 
any other standard statistical estimation requirements. In embodying the invention, 

35 more concem is given to practical, trial-based estimators for threshold values, as will be 
described. 



41 

The specific distance function used will be tuned within a specific context in practice by 
simple experiment. Whilst linear differences are easy to implement, advantages given 
by some power greater than 1 can provide more definite results when the comparison 
curves are considered. It is expected that some power in the range of 1 to 2 will be used 
5 in most practical embodiments. 

Specifically, where there are 3 rows and 3 columns of user generated scores, we start off 
with a 3 X 3 matrix. Following application of the transforms described above, three 
vectors are produced, each containing the 3 values: 

Measure^. [ S12, S13, S23]m 
Measure. [ S12, S13, Saslw 

where Measure+, Measure, or Measureo represents the +ve, -ve or same measures; S12 
10 represents the measure produced by the transform of the relationship between the first 
and second constructs subject to a specified mesh M and using a specified power in the 
distance fimction. 

The measures are generated successively for decrementing values of mesh until (or, 
indeed, if) a dominant measure emerges. The task is to seek the largest value, subject to 
15 exceeding a threshold, in the three rows of measures above. If no dominance is 
observed at any level of mesh down to 1 then the only thing we can say is that we 
cannot say anything - the search has been inconclusive. 

For any [Rm, Rn] pair we would have the following measures- 

Neg : NegTotal ; 
20 Pos : PosTotal, 

Same: SameTotal [derived as 0 since no degrees of freedom] 

For each measure, the number of scores subsumed within that measure can take a value 
between 0 and the niunber of elements less 1. 

We represent the number's value possibility as: 0-iiumber~(C - 1), 
25 and its distance value possibility as: 0~Sum(diff)~((C - 1) *(mesh - 1)) 



The following can then be inferred: 
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So: 


|Mean 




iSd* 


N 


b~(M-l) 


P~(M-1)" 


b~(M-iy 


P 


b~(M-l) 


o~(M-ir 


b~(M-i)' 


S 


io~(M-l) 


kKM-iy 


b~(M-iv 



Measures would be scaled using these upper and lower bounds to lie within the absolute 
range 0-1. 

We get the following 3 vectors: 

5 Neg [nl2, nl3 , n23] 
Pos [nl2, nl3, n23] 
Same [nl2 , nl3, n23] 

In practice the measures above will have predictable upper and lower absolute values in 
that the largest value that any of the measures above can take is: 

10 (mesh-lf . (C - 1). 

The smallest value is 0. 

The system then operates to calculate a modified form of entailment, which will be 
referred to as "dominance". 

The mesh is progressively reduced until either (a) it finds a relationship which meets the 
15 threshold value or (b) the limiting mesh value of 1 is reached. This will generally 
involve seeking the largest score amongst those presented by the agglomeration 
fimction. If no dominant measure emerges at a given level of mesh, the mesh value is 
reduced, ultimately to 1. Dominance is re-examined at each iteration. 

Output 

20 The output of the analysis performed is a determined "fiizzy measure" (either negative 
or positive since same relationships are sterile), with a value and a mesh. This will be 
used to make comparisons with other ER&M sets generated by other users. Decreasing 
mesh reduces apparent accuracy whilst increasing meaning. This is described with 
reference to Figure 5. 
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Transforming Fuzzily 

If a simple distance function (Power = 2) is used, compared with a linear distance 
function, the following benefit arises: the use of the power function depresses more the 
values that are nearer the region of lesser interest (close to 0), and depresses less as 
5 towards higher values. The tuning requirement is to estimate practical values on the 
vertical axis such that we ignore 'relationships' with a value lower than the threshold, 
e.g. 0.8 in this case. Hedges are the fuzzy logic equivalent of confidence intervals, but 
the sample size and the nature of the technique posit that they are different in meaning. 

Algorithms 

10 To make clear the nature of the algorithms that are used to calculate the relationship 
values, the following are Pascal code segments that are example implementations of the 
algorithms. 

function Entail (Mesh, Elements, Constructs: Integer; Score: string): 
string; 
15 var 

lb, ub: Integer; //Derived from the Mesh - only ub needs to be 
defined if lb always =1 

MaxDiff: Integer; 

SumRow: Integer; 
20 Element: Integer; 

SumRows : string; 

SumRow2 : string; 

SumRow3 : string; 

SumRow4 : string; 
25 SumRowS : string; 

SumRowPair : Integer ; 

SumOf Dif f s : Integer; 

HomogN: Integer; 

HomogO: Integer; 
30 HomogP : Integer; 

i, j : Integer; 

Current : Integer ; 

Next Is : Integer; 

NowRowStr : string ; 

35 ElementStr:. TStrings; 

First , Second : Integer; 

FuzzyFirst: Integer; 

Fuz zySecond : Integer ; 

NPro : Real ; 
40 OPro: Real; 

PPro : Real ; 
begin 

lb := 1; 

ub := 10; // Mesh value 9 
45 MaxDiff := (ub - lb) * Constructs; 



SumRow : = 0 ; 
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10 



SumRows : = ' • ; 

ElementStr := TStringList . Create / 

for Current : = 1 to Constructs do begin 

NowRowStr := Copy (Score, (Current - 1) * (3 * Constructs) 
Constructs * 3) ; 

ElementStr. Add (NowRowStr) ; 
SumRow := RowSum (Elements , NowRowStr); 
SumRows := SumRows + Copy ( ' 0 ' + IntToStr (SumRow) , 
Length (IntToStr (SumRow) ) , 2) ; 
end; 



+ 1, 
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for Current := 1 to Constructs - 1 do begin 
SumRowPair := 0; 

0; 

(Current +1) to Constructs do begin 
:= StrToInt (Copy (SumRows, (Current - 1) 



SumOfDiffs := 
for Next Is := 
SumRowPair : 



* 2 



1, 2)) 



20 



25 



30 



35 



40 



StrToInt (Copy (SumRows, (Nextis - 1) * 2 - 1, 2) ) ; 
for Element := 1 to Elements do begin 

First := StrToInt (Copy (ElementStr [Current] , (Element 
3)); 

Second := StrToInt (Copy (ElementStr [Nextis] , (Element 
3)) ; 

SumOfDiffs := SumOfDiffs + First - Second; 

// Homogeneity measures 

FuzzyFirst := Fuzzif y (Mesli, First); 

FuzzySecond := Fuzzif y (Mesli, Second) ; 

if FuzzySecond < FuzzySecond tlien 

Inc (HomogN) 
else if FuzzySecond = FuzzySecond then 

Inc (HomogO) 
else if FuzzySecond > FuzzySecond then 

Inc (HomogP) ; 

end; 



NPro 
OPro 
PPro 

// 

end; 
end; 

ElementStr . Free ; 
end; 



= HomogN / Constructs; 
= HomogO / Constructs; 
= HomogP / Constructs; 



// REAL 



1) * 3 
1) * 3 
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function Fuzzif y (Mesh, TheScore: Integer) : integer; 
begin 

//result := TheScore; 

TheScore := StrToInt (FormatFloat (' #0 ' , TheScore * (Mesh / 100))); 
if (TheScore < ((Mesh +1) / 2)) then 

result := -1 
else if (TheScore > ((Mesh +1) / 2)) then 

result := 1 
else 

result := 0; 

end; 



t 



45 

Appendix A - Post-Construct Modelling Example 

This appendix describes a very simple version of the post-construct ehcitation (CE) and 
fuzzy entailment (FE) econometric work which augments these stages through adding 
group-level and application-level leaming by evaluating and updating recommendations 
5 procedures, experimenting with marginal effect influences, and producing from that 
inferences which can cover the entire customer base. 

This part of the software engages after CE/FE stages have produced over 200 responses 
and purchases. As it is based on classical statistical methods and uses Maximum 
Likelihood techniques, its accuracy depends on larger nimibers. In this sense it 
10 complements perfectly the predictive capabilities and self-learning at the individual 
level. 

The post-CE/FE recommendations are evaluated using the following two-equation 

system: 

Equation 1: CE/FE-Recommendations = function of (demographics, visit 
15 characteristics) 

Equation 2: Purchase Outcome = fimction of (demographics, visit characteristics, IMR, 
responses to visit) 

For now take CE/FE-Recommendations to have been coded as follows: 
1. Strong Recommendation 
20 2. Weak Recommendation 

3. No Recommendation 
Further Data 

• Demographics (age/gender/occupation/marital status/hobbies etc.) 

• What happened during the visit (day/time/duration/windows used/other pages 
25 visited/page from/page to/other goods recommended or purchased etc.) 



• RFM information on visitor 
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• Response to the recommendations during this visit (apart from purchase or not) 



• Purchase(s) amount(s) 



Equation 2 is estimated using either the amount of purchase (then the question is 'how 
is the amount spent influenced by. . .'), or by a binary variable which is one if there was 
5 a purchase and zero if not (then the question is 'how is the decision to purchase or not 
influenced by...') as the dependent variable. The right hand side contains the 
identifying variables 'response to the recommendations' as well as the IMR stored from 
the estimation of Equation 1. 

Simple examples are provided below using a small numbers artificial data set. 

10 Starting with a binary (received recommendation or not) discrete choice model for 
Equation 1 : 

Equation 1 - Question: what relationship exists between the strength of 
recommendations and various marginal factors? 

Binomial Probit Model 
Maximum Likelihood Estimates 
Dependent variable 
Weighting variable 
Number of observations 
Iterations completed 
Log likelihood function 
Restricted log likelihood 
Chi- squared 
Degrees of freedom 
Significance level 

Results retained for SELECTION model. 

15 



Variable 


Marginal effect 


Standard Error 


t-ratio 


Constant 


-0.72267 


0.413561 


-1.747 


R 


0.00032 


0.001784 


0.180 


F 


0.04867 


0.025053 


1.943 


M 


-0.00195 


0.005147 


-0.380 


AGE 


0.04035 


0.019913 


2.026 


AGESQ 


-0.05084 


0.023694 


-2.146 



BINREC 
ONE 
100 
5 

-60.23445 
-65.34182 
10.21474 
5 

.6937447E-01 



Frequencies of actual and predicted outcomes are set forth below. Predicted outcome 
has maximum probability. 
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Predicted 




Actual 


0 


1 


Total 


0 


8 


28 


36 


1 


6 


58 


64 


Total 


14 


86 


100 



This model can be naturally extended using discrete choice models that allow for more 
than one choice (e.g. logit). The further possibility exists to use models that allow 
choices to be ordered (e.g. multinomial logit or ordered probit). 

5 Equation 2.1 

Question: Do our recommendations influence the level of expenditure in the 

Purchase? 

+ + 

10 I Ordinary least squares regression Weighting variable = none | 
I Dep. var, = PURCH Mean= 8.665100014 , S.D.= 13.04404784 j 
I Model size: Observations = 100, Parameters = 7, Deg.Fr.= 93 | 
I Fit: R-squared= 0.550307, Adjusted R-squared = 0.4954 9 | 
+ + 

15 



Variable 


Coefficient 


Standard Error 


t-ratio 


Constant 


-4 .7720 


10.2153 


-0.467 


R 


0 . 1292 


0.0463 


0.279 


F 


-0 .35058 


0 . 1600 


-2 . 191 


M 


0 .22663 


0.1044 


2 . 170 


AGE 


0,49488 


0.2070 


2.390 


AGESQE 


-0.33741 


0.1050 


-3 .213 


LAMDAl 


2.18606 


0.6518 


3 .354 



In this specific case (i.e. with this artificial data etc.) the answer is very clear, that: yes, 
the recommendations made at the CE/FE level of the software are influencing (on 
average) the total purchase amount. By how much? The relevant elasticities can be 
calculated using these coefficients and the data means. However, one should note that a 
20 Tobit model would be a better tool to use here and would be used for a large-scale 
application (as there are a nxmiber of observations clustered at the zero point: those who 
did not purchase). 

Where goods of considerably different price belong to the same set of recommendations 
this is an important question. 

25 Equation 2.2 



Question: Do our recommendations influence the choice of whether a purchase is made 
or not? 
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+ + 

I Binomial Probit Model | 

I Maximum Likelihood Estimates | 

I Dependent variable BINPURCH | 

5 I Weighting variable ONE | 

I Number of observations 64 | 

I Iterations completed 8 j 

I Log likelihood function -17.27683 j 

I Restricted log likelihood -44.33016 j 

10 I Chi-squared 54.10668 | 

I Degrees of freedom 6 j 

I Significance level .0000000 j 

+ + 



Variable 


Marginal Effect 


Standard Error 


t-ratio 


Constant 


-3 . 9077 


5.1329 


-0.761 


R 


-0,0105 


0.0074 


-1.422 


F 


-0 . 0528 


0 .0117 


-4 . 513 


AGE 


0 .0811 


0.0385 


2 . 106 


AGESQ 


-0 . 0675 


0.0241 


2 . 812 


RESP 


0 .5618 


0.1505 


3 .733 


LAMDA2 


1.9169 


0.7646 


2 .513 



15 Frequencies of actual & predicted outcomes 
Predicted outcome has maximum probability. 





Predicted 




Actual 


0 


1 


Total 


0 


27 


6 


33 


1 


4 


27 


31 


Total 


31 


33 


64 



Again, the answer to the question of whether the recommendations influence the 
20 decision to purchase or not, is yes as the coefficient of the lambda variable is positive 
and statistically significant. The marginal effect can reveal the degree to which our 
recommendations influence the total number of purchases made. 

Where all goods within the recommendation category are of rather similar price, the 
amoimt spent does not matter and this question is the pertinent one. 

25 Appendix B — Data Structures and DatabasesEntity Relationships: Figure 4 
represents the logical relationships among the entities within the application: 

Triggers/Thresholds: These are described in "Configuration issues'*, above but require 
storage of some sort. 
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Data Definitions: The following is a discussion of the data requirements that lie behind 
the logical relationships defined above. 

Domains 

As shown in Figure 4 



Domains 
Domain ID 
Description 



Subdomains 

10 

As shown in Figure 4 



SubDomains 
Owner ID 
Child ID 



1 5 Users (Customers) 

The basic data fields required for the customer are: 



Users 

ID (imported or created) 

Lastname (for addressing the user) 
Firstname (for addressing the user) 
Salutation (for addressing the user) 
E-mail address (for pushing e-mails) 
Company (if representing a 

company) 

"TJser-defined #1 
User-defined #2 



20 The field 'TJser-defined #2" for customer this might be a weighting factor such as RFM 
(Recency, Frequency, Monetary Value) in terms of previous site visits and recent 
purchases. 

A note on RFM queries: there is a well-used customer loyalty indicator known as RFM: 
recency, frequency, monetary value. RFM relates to site visits and activity of site 
25 visitors in this instance. R and F are key, as M is indicated by F. The higher each 
individual value, the higher propensity for imminent purchase and also the potential 
lifetime value (LTV) of that customer. We will be expected to build into our 
application the use of RFM to work alongside our model to enhance the predictive 
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capabilities. It is best thought of as a critical weighting factor and is mentioned here 
because clients taking on the use of the system will almost certainly wish to couple this 
to some form of RF analysis. 

Predictive coefficients (entailment values, self-learning or control values etc.) produced 
by the system for customers and customer groups can be used in conjunction with 
existing RF concatenated values to provide the strongest possible behavioural modelling 
technique that our clients' marketing personnel will want to see. This is best thought of 
as follows: 

1. R and F values are used as indicators of likelihood of purchase once the 

recommendations are given; and 

2. these values are used with other demographics to perform self-learning checks 

within the application. 

The result is that cHents maximise the profitabihty (LTV) potential from existing high 
RF performers and an indicator is given as to what products and services to promote to 
the lower RF performers in order that they remain loyal, rise in the RF rankings and 
increase their LTV to the client. 

Accepting the above, the question is how could we embed this in our design if: 

the client already has a measure of RF and can supply it (as a simple customer ID 
value and 'current RF value' for example) 

we can pick this up from web/back-end system stats. 

Users Labels 

As shown in Figure 4 

Items (Products, Elements) 

For Products, the following basic data set is required: 
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Items 

Item ID (link item or created through registration) 

Item Domain (if exist) 

*User-defined #1 

*User-defmed #2 

*User-defined #3 

*User-defined #4 



*User-defined #1 -#5 could be, for example, Product Descriptions e.g. a book might be 
title/author, a car make/model, a CD title/artist etc., or for example, an image of the 
item. 



S Labels (Constructs) 

This is a repository set up through the system i.e. does not exist prior to using it. The 
basic data set is: 



Labels 

Label ID 

Label Name 
Pole A Text 
Pole B Text 
*User-defined #1 
*User-defmed #2 
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UsersltemsLabels (Item and Label Ranking) 

Assumed to be within the Usersltemslabels entity 



Usersltemslabels 

User ID 

Label ID 

Item ID 

Absolute Score value (from slider control measurement) 

* User-defined #1 

*User-defined #2 



Orders 



15 For purchase histories, it is important for the system to be able to pick up purchase 
details. There will therefore be an order database reference required with a minimum 
data set as follows: 



52 



Order 

Order ID 

User ID 

Item ID 

Date 

Time 

Value 

*User-defined #1 
*User-defmed #2 



User defined #1-2 could be if the purchase was by credit card or debit card. Credit 
Rating retumed from transaction etc. - useful for Kostas in his experimentation with 
marginal factors, recommendations and purchases. 

5 Dynamic Label (Construct) Groupings 

This is a query that shows all constructs that are strongly bonded; i.e., that have 
entailment values above or below the trigger values for grouping. The query result 
shows, at any point in time, all constructs that strongly bond to one another within and 
across domains and all constructs that weakly bond to one another within and across all 
10 domains. There is no foreseen use for displaying constructs that have no bonds with 
other constructs. 

Usersl.^beisEntaiiments 

The system need also store fuzzy entailment values for labels resulting from each 
15 session. 



UsersLabelsEntailments 

Label ID #1 

Label ID #2 

User ID 

Session No 

Entailment Value 



UsersltemsEntailments 



UsersItemsEntailments 

Item ID #1 

Item ID #2 

User ID 

Session No 

Entailment Value 



20 
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CumulativeUsersLabelsEntailments 

We need to be able to store cumulative entailment values for Labels and Items resulting 
from prior sessions. 

CumulativeUsersLabelsEntailments 

Label ID #1 

Label ID #2 

User ID 

Total number of sessions (calculated) 

Cumulative Entailment Value* (calculated) 

* Could be average of adding all values from UsersLabelsEntailments and dividing by 
5 total number of sessions. 

CumulativeUsersltemsEntailments 

The system must able to store cumulative entailment values for Labels and Items 

resulting from prior sessions. 

CumulativeUsersItemsEntailments 

Item ID #1 

Item ID #2 

User ID 

Total number of sessions (calculated) 

Cumulative Entailment Value* (calculated) 

10 * Could be average of adding all values from UsersItemsEntailments and dividing by 
total number of sessions. 

Recommendations 

The system stores Item IDs that have been recommended to a user for comparison with 

1 5 orders (purchases) . 

Recommendations 

Item ID 

User ID 

Recommendation level — strong/weak 

Time of recommendation 

Date of recommendation 

Purchased within <trigger level> days* 

This is a measure of purchasing behaviour, which will help measure system 
performance. 

Appendix C — Fischer Linear Discriminant Analysis 

The mean of class i is given by 
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Where jc is the vector of characteristics. 

Mean of samples projected onto a linear discriminant plane w: 
w,= — 2^w X 

The separation of the projected means between class 1 and class 2: 
Scatter matrix of the projected means: 

yew, 



The Fisher criterion is the ratio: 



S\+S\ 



We define 



Sy^—S\~^S2 

=>if= X M''"(ji;-iii,)(x-i«,)'w 



and 
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Similarly, 

where S^={m^-m2){m^- m^f , 
5 Siv is known as the *within class' scatter matrix 
Sb is known as the T^etween class' scatter matrix 
The criterion to maximise is 



Differentiating with respect to w gives: 
10 f-y^ 72 =0 



So the solution must satisfy 



where a is the ratio 



a- ^ 



15 Since is in the same direction as (mi - ma) 

As we only require the direction of w for the discriminant function the magnitude is 
unimportant, as is the value of jS. 



